ON COMMUTING MATRICES IN MAX ALGEBRA AND IN 
CLASSICAL NONNEGATIVE ALGEBRA 

RICARDO D. KATZ, HANS SCHNEIDER, AND SERGEI SERGEEV 

Abstract. This paper studies commuting m.atrices in max algebra and nonnegative linear 
algebra. Our starting point is the existence of a common eigenvector, which directly leads to 
C) ' max analogues of some classical results for complex matrices. We also investigate Frobenius 

normal forms of commuting matrices, particularly when the Perron roots of the components 
I>^' are distinct. For the case of max algebra, we show how the intersection of eigencones of 

commuting matrices can be described, and we consider connections with Boolean algebra 
which enables us to prove that two commuting irreducible matrices in max algebra have a 
common eigennode. 
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1. Introduction 



< 

^_ 
c^ ', The study of commuting complex matrices has a long history. As observed in [13], Cayley 

considers what appears to be a generic case of commuting matrices in his famous memoir [7J. 
Frobenius [Ul [IS] showed that if Ai, i = 1, . . . ,r, are pairwise commuting matrices, then 
the eigenvalues a^, j = 1, . . . ,n, oi the matrices Ai may be ordered so that the eigenvalues 
^ . of any polynomial p{Ai, . . . , Ar) are p{a{, . . . a^)^ j = 1, . . . , n. Another proof may be found 

^ I in Schur [35] . Surprisingly, none of these proofs mention eigenvectors. Frobenius [15] also 

"^ ' showed that if for given matrices A, B the equation AX = XB has a nonzero solution, then 

A and B have a common eigenvalue. Another well-known result is that pairwise commuting 
matrices have a common eigenvector. We have found no reference for the first explicit 
O ! appearance of this property, though it easily follows from e.g. the canonical form derived by 

Weyr [37] and his discussion of commuting matrices. Many generalizations and applications 
of this result exist, see [14j, [32j or |[28j. Several books on matrix theory, such as [20], contain 
K^ , proofs of the results stated above. 

Hi It is the purpose of this paper to prove analogs of these results for matrices over two 

semirings: 

1. the semiring of nonnegative reals under the usual addition, here called (classical) 
nonnegative algebra, and 

2. the semiring of nonnegative reals with the operation of maximum playing the role of 
addition, here called max algebra. 

Spectral theory of matrices in nonnegative algebra is usually called Perron- Frobenius the- 
ory after the founders of this topic, see ^291 (SOj [TTl [HI [19]. The basic results are again found 
in many books on matrix theory, such as [20l[2H [33]. Commuting nonnegative matrices can 
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be found in [3], see Section [TJ and in [31]. For further information relevant to the present 
article see [33] . 

Spectral theory for matrices in max algebra was developed by Cuninghame- Green [9] and 
Gaubert [2T], see [Sill] for recent expositions. 

See [TTl \n\ for studies of commuting matrices in more general semirings. 

We devote the main sections to properties of commuting matrices in max algebra. At 
the end of this introduction we give a formal definition of max algebra and make some 
remarks on the relation between the two theories. We then review basic max algebra spectral 
theory in Section [2] (for those who are unfamiliar with this topic). We provide a proof that 
pairwise commuting matrices have a common eigenvector in Section [31 We also derive 
some immediate consequences of this theorem, concerning inequalities for Perron roots and 
matrix polynomials, and describe the intersection of principal eigencones by means of the 
product of spectral projectors. In Section HI we investigate Frobenius normal forms of 
commuting matrices, showing that in the important special case where the Perron roots 
of the components are distinct, the transitive closures of the associated reduced digraphs 
coincide. In Section [S] we consider the eigenvector scaling, which leads us to study commuting 
matrices in Boolean algebra. As a result of this study we show that the critical digraphs of 
two commuting irreducible matrices in max algebra share a common node. In Section [7] it 
is indicated that most results in Sections [3] and H] also hold in nonnegative matrix algebra. 
Section [6] is devoted to numerical examples. 

By max algebra we understand the analogue of linear algebra developed over the max- 
times semiring (M_|_, ©, x), which is the set of nonnegative numbers M+ equipped with the 
operations of "addition" a © 6 := max(a, b) and ordinary multiplication a x b. The zero 
and unity of this semiring coincide with the usual and 1. The operations of the semiring 
are extended to nonnegative matrices and vectors in the same way as in conventional linear 
algebra. That is, ii A = [aij), B = {bij) and C = (qj) are matrices of compatible sizes 
with entries in ]R_(., we write C = A (B B ii Cij = a^ © bij for all i,j and C = A ® B if 
Cij = (Bk^ikbkj = niaxfc(ajfcfeA;i) for all i,j. If ^ is a square matrix over M+, then the iterated 
product A^ A^ ■ ■ ■ ^ A in which the symbol A appears k times will be denoted by A''. 

It is significant that max algebra can be obtained from nonnegative linear algebra by 
means of a limit passage called Maslov dequantization [27] : 

(1) a©6= lim a©„6 , 

where a(Bpb := {a^^^ + b^^'^Y. Note that (M+, ©p, x) forms a semiring which is isomorphic 
to the semiring (M+,+, x) of nonnegative numbers equipped with the usual addition and 
multiplication. Thus one may expect, and this is indeed the case, that max algebra and 
nonnegative linear algebra have many interesting properties in commoro. For example, 
the Frobenius (normal) from of a reducible matrix plays an important role in the study of 
reducible matrices in both theories. In view of the above discussion, it is not surprising that a 
comparison of spectral properties of reducible matrices shows that one needs to replace strict 
inequalities in classical nonnegative spectral theory by weak inequalities in max algebraic 
spectral theory, see [5] for a remark along these lines concerning eigenvectors. 



Referring to max algebra spectral theory, Gaubert j23j remarks "The theory is extremely similar to the 
well known Perron- Frobenius theory" . 
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(2) A(A) = (a,,,, ■ ■ ■ a,,,, 



The above notation employing © and ® is standard in max algebra. However, as many 
results of the present paper are true both in max algebra and in nonnegative linear algebra, 
it will be convenient to write a + b for max(a, b) when the argument works in both theories. 
On the other hand, we emphasize by using the specific max algebraic notation when this is 
not the case. 

2. The spectral problem in max algebra 

We recall here some notation and basic facts about the spectral problem in max algebra, 
which we use further in this paper. See [2llU[9l[25] for general reference and more information. 

The max algebraic spectral problem for A G M"^" consists in finding eigenvalues a G R+ 
and nonzero eigenvectors v G M" such that Av = av is satisfied. Observe that the set 
V{A, a) := {v \ Av = av} is a (max) cone of M" , that is, a subset of M" closed under (max) 
addition and (nonnegative) scalar multiplication. This cone will be called the eigencone of 
A associated with a. The set of eigenvalues, which is nonempty like in the usual Perron- 
Frobenius theory, is called the spectrum of A and denoted A{A). The largest eigenvalue of A 
will be denoted X{A) and called the Perron root of A (since we want the same terminology 
for max algebra and nonnegative matrix algebra), and the associated eigencone will be called 
the principal eigencone of A. 

Unlike in the case of classical algebra, there is an explicit formula for the max algebraic 
Perron root oi A = (a^^) G M^^^": 

n 

1/fc 

k=l ii,...,ik 

This is also known as the maximal cycle (geometric) mean of A. 

For A G M"^" we construct the associated digraph Q = {N, E) by setting N = {1, . . . ,n} 
and letting (i, j) G E whenever aij > 0. When this digraph contains at least one cycle, one 
distinguishes critical cycles, where the maximum in (|2]) is attained. Further, one constructs 
the critical digraph C{A) = {N^, E^), which consists of all the nodes N^ and edges E^ of Q 
on critical cycles. The nodes in A*"^ will be called critical nodes or eigennodes. 

The critical digraph is closely related to the series 

(3) A* = I®A®A^ ®--- , 

where / is the unit matrix. This series is known to converge if, and only if, \{A) < 1, in 
which case it is called the Kleene star oi A. If X{A) < 1, then this series can be truncated: 
A* = /©A©A2©...©A'^-i. 

For A G M"^" such that X{A) = 1, the principal eigencone is the set of max-linear 
combinations of all columns of A* with indices in A^^: 

(4) y(Ai) = {®.e7vAA^* IAeM+} . 

In particular, we have 

(5) AA*i = A*i , A* A = A*, , Vz G Nf . 

Thus, unlike in the usual Perron- Frobenius theory, even if A G R"^" is irreducible (that is, 
the associated digraph is strongly connected), the principal eigencone in max algebra may 
contain more than just one ray. However, for irreducible A, X{A) given by ([2]) is the only 
eigenvalue and every eigenvector is positive, see Theorem 14. II below. 



By standard optimal path algorithms, the critical digraph and the columns of A* can be 
computed in 0{n^) operations. For further details we refer the reader to [U [251 12] • 

A (max) cone K C M^ is said to be finitely generated if it is the set of max-linear 
combinations of a finite subset of vectors of M". Equivalently, a cone K C M" is finitely 
generated if there exists a matrix X G M"^'', for some r G N, such that K = Im(X), where 
as usual Im(X) := {Xu \ u G W^}. Observe that if K is not trivial, we may assume that 
X does not have a null column. By (|1]), it follows that the principal eigencone is finitely 
generated. Indeed, this property holds for any eigencone of A, see e.g. [5i, Theorem 4.1]. 
Therefore, in what follows, for a G A(y4) we shall denote by X^ any matrix with nonzero 
columns satisfying V{A,a) = Im(X^). 

Let us finally mention that like in classical algebra, any finite intersection of finitely gen- 
erated (max) cones is also finitely generated (this property follows from [6], see e.g. [22| 
Theorem 1]). 

We summarize the main properties that will be used in this paper in the next proposition. 

Proposition 2.1. In max algebra the following statements hold: 

(i) Every matrix has an eigenvalue with a corresponding eigenvector; 
(a) Eigencones are finitely generated; 
(Hi) The intersection of two finitely generated (max) cones is finitely generated. 

Further information on max algebra spectral theory will be given in Section |H 

3. Existence of common eigenvectors 

3.1. Common eigenvector of two matrices. In this section on max algebra we prove 
that two commuting matrices have a common eigenvector. With this aim, we shall need the 
following lemma. 

Lemma 3.1. If A,B G M"^" commute, then any eigencone V{A,a) of A is invariant under 
B and any eigencone V{B^a) of B is invariant under A. 

Proof. Let v G V{A, a). For u = Bv, we have 

(6) Au = ABv = BAv = aBv = au . 

Therefore, B{V{A, a)) C V{A, a). D 

Now it is possible to prove the following result, which relates the eigencones of two com- 
muting matrices. 

Theorem 3.2. If A,B G R"^" commute, then for any eigencone V{A,a) of A there exists 
an eigencone V{B,fi) of B such that V{A,a) fl V{B,fi) contains a nonzero vector. 

Proof. Let V{A, a) = Im(X^) be an eigencone of A. Then, 

(7) AX^ = aX^ , 

and since by Lemma [XT] we have B(lm{X^)) C Im(X^), there exists a (nonnegative square) 
matrix C such that BX^ = X^C. Let z be any eigenvector of C, so that Cz = fiz and 
z ^ 0, and consider u = X^z. Then, u y^ (recall that all the columns of X^ are nonzero) 
and we obtain 

Au = AX^z = aX^z = au 
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and 

Bu = BX^z = X^Cz = fiX^z = fiu . 
T\ms,ueV{A,a)nV{B,fi). D 

As an immediate consequence, we obtain: 

Corollary 3.3. If A,B & R^^" commute, then they have a common eigenvector. 

We remark that our proof of Theorem 13.21 also shows the following result: 

Proposition 3.4. Let A G M"^" and let K be a (nontrivial) finitely generated cone ofW^. 
If AK C K, then A has an eigenvector in K. 

3.2. Common eigenvector of several matrices. The results above can be generalized to 
several pairwise commuting matrices. 

Theorem 3.5. Assume the matrices Ai, . . . ,Ar G M^^" commute in pairs. Then, given any 
eigenvalue ai G A{Ai), where i G {l,...,r}, there exist aj G A(ylj) for j ^ i such that 
V{Ai, tti) n ■ ■ ■ n V{Ar, ar) contains a nonzero vector. 

Proof. The case r = 2 is precisely Theorem 13.21 So assume that the statement of the theorem 
holds for r = k and let Ai, . . . , Ak, Ak+i he k + 1 matrices which commute in pairs. 

Without loss of generality, assume ai G A(y4i) is given. By the induction hypothesis, 
there exist aj G A{Aj), for j = 2, . . . , k, such that V{Ai, ai) fl ■ ■ ■ fl V{Ak, ak) contains a 
nonzero vector. Moreover, since by Proposition 12.11 any eigencone is finitely generated and 
any finite intersection of finitely generated max cones is also finitely generated, there exists 
a (nonnegative) matrix X such that V^(^i, ai) fl • ■ ■ fl V{Ak, aj.) = Im(X). Note that we may 
assume, without loss of generality, that all the columns of X are nonzero because Im(X) 
contains nonzero vectors. 

Since Ai and A^^i commute for i = 1, . . . ,k, hj Lemma [3.11 it follows that 

Ak+i{V{Ai,ai))CV{A,ai) 

for 2 = l,...,fc. Therefore, Ak+i{lm{X)) = Ak+i{n>i^,V{Ai,ai)) C r\^^^V{Ai,ai) = Im(X) 
and thus there exists a (nonnegative square) matrix C such that A^+iX = XC. 

As in the proof of Theorem 13. 2[ let z be any eigenvector of C so that Cz = fiz, for some 
fi G A(C), and define u = Xz. Since z ^ and the columns of X are nonzero, we have 
u y^ and 

Ak+iu = Ak+iXz = XCz = iiXz = fiu . 

Thus, u G Im(X) n V{Ak+i,fi) = V{Ai, ai) n ■ ■ ■ n V{Ak, ak) n V{Ak+i, fi). D 

Next we investigate the eigenvalues of polynomials of commuting matrices. Let us recall 
that a max polynomial is obtained by replacing in a real polynomial (with nonnegative 
coefficients) the usual sum by the maximum. 

Theorem 3.6. Let Ai, . . . ,Ar G M"^" commute in pairs and let p{xi, . . . , Xr) be a max 
polynomial. Then, 

(i) For each i G {1, ■ ■ ■ ,r} and ai G A{Ai), there exist aj G A{Aj) for all j y^ i such that 

p(ai, . . . , ar) G A(p(Ai, . . . , Ar)); 
(a) For each A G A{p{Ai, . . . ,Ar)) there exist ai G A{Ai) for all i = 1, . . . ,r such that 
X = p{ai,. . .,ar). 
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Proof. (^ Let i G {1, . . . , r} and a^ G A(Aj). By Theorem 13.51 there exist aj G A(Aj) for all 
j ^ i and a nonzero vector v G R" such that AiV = aiV for alH = 1, . . . , r. But then we also 
have p(Ai, . . . , Ar)v = p{ai, . . . , ar)v, and so p(ai, . . . , ar) G A(p(y4i, . . . , A,.)). 
dH]) Let A G A(p(y4i, . . . , A^)). Since Ai,...,Ar and p{Ai, ... ,Ar) commute in pairs, by 
Theorem 13.51 there is an eigenvector v G V{p{Ai, . . . ,Ar),X) which is also an eigenvector 
of Ai associated with some eigenvalue ctj G A{Ai), for all i = l,...,r. But then Xv = 
p{Ai, . . . , Ar)v = p{ai, . . . , ar)v and it follows that A = p(ai, . . . , ar). □ 

Corollary 3.7. Let Ai, . . . ,Ar G M"^" commute in pairs and let p{xi, . . . , Xr) be a max 
polynomial. Then, 

(z) X{p{A,,...,Ar))<p{X{A,),...,X{Ar)); 
(ii) X{Ai + --- + Ar)< X{Ai) + ■■■ + X{Ar); 
(ill) X{Ai---Ar) <X{Ai)---X{A,). 

Moreover, equality holds in all the above relations if the matrices Ai, . . . ^A^ are irreducible. 

Proof. Part (jl]) follows from Theorem 13. 6[ and parts dn]) and ( pnj) are its special cases. If 
the matrices are irreducible, then each of them has unique eigenvalue, and we have the 
equalities. D 

In the case of max algebra we also have X{Ai © ... © A.,.) > X{Ai) for alH = 1, . . . , r, as 
the Perron root expressed by ([2]) is monotonic. Hence (jn]) always holds with equality in max 
algebra. 

3.3. Intersection of principal eigencones. A matrix Q is called a projector on a cone 
K C M^ if Im((5) = K and Q^ = Q. This implies that Qx = x if, and only if, x & K. 
In general, there are many projectors on the same cone, but if two such projectors P, Q 
commute, then they are identical because we have Px = QPx = PQx = Qx for all x G M" . 
We recall that the eigencone V{A, X{A)) associated with X{A) (assumed to be nonzero) 
is called the principal eigencone of A and a projector on V{A, X{A)) which commutes with 
A is called a spectral projector for A. Since V{A,X{A)) = V{A/X{A),1), there is no loss 
of generality in assuming that X{A) = 1. In max algebra, one can explicitly define such 
projector. There are two definitions in the literature: 

(8) Q{A) = A*4*. , 

and 



(9) Q(A)=lim0A 



p— >oo 

m>p 

The first of these is found in BacceUi et al. [2^ Section 3.7.3], see also ^, and the second one, 
which is attributed to Yakovenko [5H], is found in a more general context in Kolokoltsov and 
Maslov [261 Section 2.4]. 

We shall need the following proposition, which shows that these projectors are indeed 
identical. See [261 Theorem 2.11] for a closely related result. 

Proposition 3.8. Let A G W^^" with X{A) = 1. Then, there is a unique spectral projector 
on V{A,1) which is given, equivalently, by (^ or (^. 
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Proof. In the first place, note that in the matrix case, ([9]) may be replaced by 

(10) Q{A) = lim A^A* , 

p— >-oo 

see the remarks on A* in Section |2J Since by (^ we have A'^^^A* < AP A* .^ it follows that 
the limit in fITOl) exists. 

By the continuity of operations, limp_5.oo (C*pi?) = (limp^oo C'p)-B for any converging se- 
quence of matrices C^ and any matrix B. Using this, we observe that if B is any matrix 
which commutes with A, then B also commutes with Qi^A). Since as shown above any 
two commuting projectors on the same cone are identical, we conclude that any spectral 
projector for A is equal to (5(A). Therefore, in particular we have Q{^Al) = Q{A). D 

Next we state two lemmas. The first one exploits iQ and follows from the continuity of 
multiplication. The second lemma is standard and its proof is recalled for the convenience 
of the reader. 

Lemma 3.9. If A, B E R^^"' commute, then Q{A) and Q{B) commute. 

Lemma 3.10. Let Qi, i = 1, . . . ,r, be commuting projectors. Then, 

(11) Im(Qi) n ■ ■ ■ n Im(Q,) = Im(gi • • • Q,) . 

Proof. If X G Im(Qi)n- ■ ■nlm((5r), then QiX = xioi i = 1, . . . ,r, and hence (Qi ■ ■ ■ Qr)x = x. 
Thus, X G lm{Qi ■ ■ ■ Qr)- Conversely, if x G Im((5i ■ ■ • Qr), then (Qi • ■ • Qr)y = x for some 
vector y. Multiplying this equation by Qi, ioi i = 1, . . . ,r, using the idempotency of Qi and 
commutativity, it follows that QiX = x. This completes the proof of the lemma. D 

Lemma 13.101 implies that we can express the intersection of the principal eigencones of 
commuting matrices as follows: 

(12) V{Au 1) n ■ ■ ■ n V{Ar, 1) = Im(Q(Ai)) n ■ ■ • n Im(Q(^)) = V{Q{Ai) ■ ■ ■ Q(^), 1) . 

In the general (reducible) case, this intersection may reduce to the zero vector. Since by flill|) 
of Corollary 13.71 we have X{Q{Ai) ■ ■ ■ Q{Ar)) < 1, it follows that (fT2|) is not trivial if, and 
only if, the Perron root of Q{Ai) ■ ■ ■ Q{Ar) is 1, in which case this intersection is given by the 
principal eigencone of Q{Ai) ■ ■ ■Q{Ar). Using definition (|8]), we can compute this product 
in 0{rn^) operations, and then it requires no more than 0{n^) operations to compute its 
Perron root and describe its principal eigencone when the Perron root is 1. 

4. Frobenius normal forms 

Let g = [N, E) be the associated digraph of A G M!^''" and ^^ = (A^^^, E^), for /x = 1, . . . , t, 
be the connected components of Q. We construct the reduced digraph TZ with set of nodes 
{1, . . . , t} setting an edge (/x, z/) whenever there exist i G A^^ and j G A^^ such that {i,j) G E. 
We shall call a connected component (or the corresponding set of nodes) of ^ a class of A 
and also use that term for the nodes of TZ. Further, we also identify subsets S of nodes of TZ 
with the union of the corresponding classes of A, that is S may denote U^t^sN'^- 

Each class /i is labeled by the corresponding maximal cycle (geometric) mean a^, which 
will be also called the Perron root of the class. We write /i — )■ z/ if /i = «/ or if there exists a 
path in 7^ connecting /i to z/ (in other words, if /i has access to z/). A set / of classes is an 
initial segment of 7^ if z/ G / and fi ^ u imply that ^ E I. The set of all classes n such that 
fi ^ u will be denoted by Intl(z/) and called the initial segment generated by u in 7?.. If S is 
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a set of classes, then a class z/ G S" is said to be initial in S" if /i — )■ z/ and /i G 5* imply that 
H = V. Similarly, a class z/ G S* is called final in S" if z/ — )■ /x and fi & S imply that fi = u. An 
initial (resp. final) class in {1, . . . ,t} is simply called initial (resp. final). A class u is said 
to be spectral if u is initial, or if a,^ > and fi ^ u imply that a^ < ay. A spectral class v 
is called premier spectral if /i — ;■ z/ and /i 7^ z/ imply that a^ < a^. 

Access relations for Q and 7^ are normally visualized in terms of a Frobenius form. There 
exists a similarity permutation of A such that 





/ An 

A21 



A 



A 



22 



A 



\ 



(t-i)i 

An 



A 



(4-1)2 

A 



t2 








^(t-l)(t-l) 

At{t-i) 
,t. 








AuJ 



with irreducible diagonal blocks A^^ for yU = 1, 

A Frobenius (normal) form of A arises from each total ordering of the classes of TZ that 
is anti-compatible with the partial order given by the access relations, viz. fi ^ u implies 
H > u. In particular, given any initial segment I oi TZ there is a Frobenius form of A for 
which the classes of I are r, r + 1, . . . , t for some r G {1, . . . , t}. 

We now state the fundamental spectral theorem of max algebra. Recall that the support of 
a vector x G M" consists of alH G A^ such that Xj > 0. 

Theorem 4.1. Let A G R"^" and X G M+. Then, a subset U of N is the support of an 
eigenvector associated with A if, and only if, 

(i) There is an initial segment I of 71 such that U = U^^iN'^ , 

(a) All final classes u in I are spectral and satisfy a^ = \. 

This theorem has a long history and has been stated in different ways, see e.g. [231 1211 
[SI El m [2] . The statement in Theorem 14.11 is essentially the same as the one that appeared 
in [23]. 

The following corollary is immediate. 

Corollary 4.2. Let A G M"""". Then, 

(i) A is an eigenvalue if, and only if, there is a spectral class v such that a^ = X; 
(a) u is a spectral class if, and only if, there exists an eigenvector with support Intl(z/); 
(Hi) A spectral class v is premier spectral if, and only if, any eigenvector associated with a^ 

whose support is contained in Intl(z/) has its support equal to lntl{u); 
(iv) If the reduced digraph of A has a unique spectral class v with Perron root ay, then any 

eigenvector associated with ay has support Intl(z/); 
(v) If the Perron roots of all classes are distinct, then all spectral classes are premier spectral 
and all eigenvectors have support Intl(z/^ for some spectral class v. 

The following well-known corollary also follows easily from Theorem 14. 1[ 

Corollary 4.3. For any A G R"^" with \{A) > the following statements are equivalent: 
(i) A has a positive eigenvector. 

(a) The Perron root of any final class is X{A) (and so, in particular, all final classes are 
spectral). 

If either condition holds, then any positive eigenvector is associated with the eigenvalue X{A). 



The proof of our next lemma essentially repeats arguments used to prove Corollary 13.31 
and Theorem! 



Lemma 4.4. Let A G R+''" and C G RI^'^'". If AX = XC, where X G M+''"' and every 
column of X is nonzero, then any eigenvalue of C is also an eigenvalue of A. 

Proof. Suppose that A G A(C) and let z G M™ be an eigenvector of C associated with A. 
Then, AXz = XCz = XX z. Since every column of X is nonzero, we have Xz ^ and thus 
AgA(A). d 

If A and C are irreducible, then in Lemma 14.41 it is enough to assume that X is nonzero 
because the vector z in the proof above is positive. Thus, we obtain: 

Lemma 4.5. Let A G M"""" and C G M+ """ be irreducible matrices. If AX = XC, where 
X G M!^^"" is nonzero, then \{A) = A(C). 

The following important lemma indicates what happens if a matrix commutes with an 
irreducible matrix. 

Lemma 4.6. If A,B G R"^" commute and B is irreducible, then 

(i) The Perron root of every final class and every initial class of A is \{A) (and so, in 
particular, all final classes are spectral); 

(a) A has the unique eigenvalue X{A); 
(Hi) If A is reducible, then at least two distinct classes of A have Perron root \{A). 

Proof. In the first place, note that the lemma is obvious if \{A) = 0, so we may assume that 
\{A) > 0. 

dl]) From Corollary 13.31 we know that A and B have a common eigenvector. Since B is 
irreducible, all its eigenvectors are positive. It follows by ([ii]) of Corollary 14.31 that all final 
classes of A have Perron root X{A) and are therefore spectral. Similarly, the transpose A^ 
commutes with the irreducible matrix B^ and therefore all final classes of A^ have Perron 
root X{A). But the final classes of A'^ are precisely the initial classes of A. 

(juj) This follows easily from ([!]), Theorem 14.11 and the definition of spectral class. 

flill|) If A is reducible, either it has two initial classes or an initial class and a distinct final 
class. D 

Remark 4.7. In Corollary 13.71 the irreducibility assumption can be relaxed. We need there 
that just one of the matrices is irreducible, for then by ([n]) of Lemma [4.61 each matrix has a 
unique eigenvalue. 

The transitive closure of TZ is the digraph 7?.* which has the edge (/i, u) if, and only if, 
fi —> u in TZ. We shall say that z/ covers fi in 7^* if u ^ fi, u ^ fi and the following property 
is satisfied: u ^ 6 -^ fi implies that either 6 = fi or 6 = u. 

The main result of this section is the following theorem. 

Theorem 4.8. Suppose that Ai,...,Ar G M^^" pairwise commute and that all classes of 
Ai, for each i E {1, . . . , r}, have distinct Perron roots. Then, 
(i) All classes of Ai, . . . , Ar and Ai + ■ ■ ■ + Ar coincide; 

(ii) The transitive closures of the reduced digraphs of Ai, . . . ,Ar and Ai + - ■ ■ + Ar coincide; 
(Hi) The spectral classes of the reduced digraphs of Ai, . . . ,Ar and Ai + ■ ■ ■ + A^ coincide. 
In particular, Ai, . . . ,Ar have the same number of distinct eigenvalues; 
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(iv) Let /ii,...,/im be the common spectral classes of Ai, . . . ,Ar and denote the Perron 
root of the fij-th class of Ai by al- Then, for any max polynomial p(xi, . . . ,Xr), the 
eigenvalues of p{Ai, . . . , Ar) are precisely p{a{, . . . , al) for j = 1, . . . ,m (possibly with 
repetitions). 

Proof, dl]) Suppose that C := Ai + ■ ■ ■ + Ar is in Frobenius form and partition Ai, for 
i = 1, . . . , r, correspondingly. Evidently, a Frobenius form of i? := Ai, for z = l,...,r, isa 
refinement of the Frobenius form of C. Since B^n and C^^ commute and C^^ is irreducible, 
by ( pHl) of Lemma [4.61 and our assumption, it follows that 5^^ is also irreducible. Therefore, 
B = Ai is also in Frobenius form. This proves ([1]). 

(juj) Now suppose that z/ covers /i in the reduced digraph associated with C. Then, for 
B := Ai the matrices 

b"" b ) -d (c"" c 

commute and, by assumption, C^^ 7^ 0. Suppose that By^ = 0. Examining the (2, 1) block 
of the products of these matrices we obtain 

Since B^^ and B^^ are irreducible, it follows from Lemma [4.51 that the Perron roots of 5^^ 
and Byy are equal. This contradicts our assumption and hence B^^ 7^ 0. But two transitive 
digraphs coincide if the cover relations are identical. This proves ([11]). 

dm]) In the first place, observe that any initial segment Intl(z/) generated by a class u in the 
reduced digraph associated with one of the matrices Ai, ..., Ar or Ai + - ■ ■+Ar is independent 
of the choice of the matrix because the transitive closures of their reduced digraphs coincide. 
For this reason, in what follows we shall denote by Intl(z/) this common initial segment and 
we shall not specify the matrix it corresponds to. 

Let fij be a spectral class of Ai. Since all classes of Ai have distinct Perron roots, from ^vj) of 
Corollary 14. 21 it follows that every spectral class is premier spectral and that every eigenvector 
of Ai associated with a^ has support Intl(/ij). But, by Theorem 13.51 there are eigenvalues of 
Ak for k ^ i that share an eigenvector with the eigenvalue a^ of Ai. Since this eigenvector 
has support Intl(/ij), by ([11]) of Corollary 14.21 it follows that fij is a spectral class for all Ak. 

Note that the above argument shows that any spectral class of Ai is also a spectral class 
oi Ai + ■ ■ ■ + Ar. To prove the converse in max algebra, suppose that /i is a spectral class of 
Ai + ■ ■ ■ + Ar. Using the additivity of Perron roots (see Corollary 13.71) . we obtain 

(14) (BU KiAU) = X{{(BUA,U) < x{{(b:=,a,),,) = (BUHiA),,) , 

for all u G Intl(/i). Without loss of generality, assume that ©[^iA((Aj)^^) = A((Ai)^^). 
Then, from (IT^ it follows that \{{Ai)yy) < A((Ai)^^) for all z/ e Intl(/i), implying that fi is 
a spectral class of Ai, and hence of all Ai. 



fjivl) By Theorem 13. 5[ for each common spectral class fij of Ai,...,Ar there exists a 
common eigenvector v^ which has support Intl(/ij). Since AiV^ = a\v^ for i = l,...,r, 
it follows that p{Ai, . . . , Ar)v^ = p{a{, . . . , al)v^ and thus p{a{, . . . , al) is an eigenvalue of 
p{Ai, . . . , Ar). Let now A be an eigenvalue of p{Ai, . . . , Ar). As p{Ai, . . . , Ar) commutes 
with Ai for all i = 1, . . . , r, by Theorem 13.51 there exists an eigenvector v of p{Ai, . . . , Ar) 
associated with A which is also an eigenvector of Ai for all i. Then, by (jvj) of Corollary 14.21 
there exists a common spectral class fij oi Ai, . . . , Ar such that the support of v is equal to 
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Intl(/ij). Therefore, we have AiV = alv for alH = 1, . . . , r, implying that A = p{a{, . . . , a^) 
because \v = p{Ai, . . . , Ar)v = p{a{, . . . , ai)v. D 

As it was aheady observed, under the assumptions of Theorem I4.8[ the eigenvalues a^, 
i = 1, . . . ,r, of the matrices Ai,...,Ar are associated with some common spectral class 
Hj of their reduced digraphs. We next show how to compute the intersection of the cor- 
responding eigencones. Let I be the initial segment generated by the spectral class fij in 
any of the reduced digraphs associated with the matrices Ai (recall that this initial segment 
is independent of the choice of the matrix because the transitive closures of their reduced 
digraphs coincide). We write uniquely each vector x G M" as x[I] + x[I'], where /' is the 
complement of J in {1, . . . ,n}. Since I is an initial segment of the reduced digraphs asso- 
ciated with all the matrices Ai, there is a Frobenius form of all these matrices such that 
/ = {r, r + 1, . . . , t} for some r G {1, . . . , t}. If we denote the submatrix of A^ based on 
the set of classes / by Ai[I, I], then as the matrices Ai, . . . ,Ar commute in pairs, it follows 
that also the matrices Ai [/,/], . . . ,y4r[/, /] commute in pairs. Therefore, we can apply the 
method described in Section 13.31 to compute the intersection of their principal eigencones. 
Moreover, by Corollary 14.21 we know that x G V{Ai, a{) fl ■ ■ ■ fl V{Ar, a^) if, and only if, 
x[I'] = and x[I] G V^(Ai[/, /], al) fl ■ ■ ■ fl V{Ar[I, I], a^), where the latter is the intersection 
of the principal eigencones of y4j[J, /], because by the definition of these matrices we have 
A(A[/,/]) = a-'foralH = l,...,r. 

5. Common scaling and application of Boolean algebra 

5.1. Common scaling and saturation digraphs. The whole of this section is in max 
algebra only. It is inspired by the works of Cuninghame- Green and Butkovic [IHlll], where 
commuting matrices are studied in the context of two-sided systems and generalized eigen- 
problem. In these works, commuting irreducible matrices are assumed to have a common 
eigennode. We are going to show that it is always the case. 

If ^ = [aij) and B = (bij) are irreducible and AB = BA, then they have a common positive 
eigenvector u, and using U = diag(M) they can be simultaneously scaled to A := U~^AU 
and B := U~^BU. Assumed that X{A) = X{B) = 1, we obtain for A = (dij) and B = (bij) 
that 

Au = u =^\/i3j : aijUj = Ui <^ dij = 1 , 

Vz, j : ttijUj < Ui ^ dij < 1 . 

(15) 

Bu = u =^\fi3j : bijUj = Ui ^ bij = 1 , 

Wi,j : bijUj < Ui 4^ bij < 1 . 
Defining A^^^ = (sg') and B^^^ = {bf^) by: 



~[i] _ J 1 if flij = 1 , gi] _ I 1 iibij = l, 
^■' ' otherwise. ^■' \ otherwise. 



(16) aw= : \:--:^ ^i 



we obtain that 

(17) VGj:5Sjl = l , VGA;: 6^ = 1 
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This means that both A'^' and B^^^ are incidence matrices of digraphs Qi = {N, Ei) and 
Q2 = {N,E2), where each node has a nonzero number of outgoing edges. These digraphs 
are the saturation digraphs of u with respect to A and B, meaning that {i,j) G Ei (resp. 
(i, j) G E2) if, and only if, aijUj = Ui (resp. hijUj = Ui). We recall the following well-known 
result. 

Proposition 5.1 (Baccelli et al. [2]). Let A E M"^" be irreducible and let u G M" be an 
eigenvector of A. Then, the strongly connected components of the saturation digraph of u 
with respect to A are the same as that of the critical digraph C{A). 

This proposition tells us that the strongly connected components of Qi and Q2 are those 
ofC(A) andC(5). 

5.2. Commuting Boolean matrices. Now we study in more detail the case of Boolean 
matrices, to show that two irreducible commuting matrices in max algebra always have a 
common eigennode. In a similar way, the graphs of commuting Boolean matrices are studied 
in [11], Proposition 10] to make an observation about the general case. 

We need a couple of simple facts, which combined with Proposition 15.11 will provide the 
connection between max algebra and the Boolean case. 

Lemma 5.2. // the matrices A,Be M"^" are such that aij < 1 and bij < 1 for all i,j G A^, 
then (A5)W = AW5W. 

Proof. For all i,k E N, we may have two cases: 

n n 

(18) ^aijbjk = l or ^aijbjk<l. 

In the first case of 0181) . there exists h such that aihbhk = 1, which implies aih = b^k = 1, 
since aij < 1 and hj < 1 for all i and j. Passing to A^^^ and B^^\ we have a\,l = foj^j. = 1 and 
thus a\,lb\^l = 1. Using this we obtain 



(19) ©<'^S = 1- 

In the second case of (I18p . there are no such h as above, and we obtain 



(20) ©«I?&S = 0- 

It follows that (A5)[il = A^^^BK. D 

We immediately deduce the following observation. 

Lemma 5.3. // the matrices A,Be M"^" are such that AB = BA and a^j < 1, % < 1 for 
alii,] G A^, then ^W^W = SW^W. 

This motivates us to study the Boolean case in more detail. 
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Theorem 5.4. Let Qi and Q2 he two commuting digraphs (meaning that their incidence 
matrices commute) with nonzero out-degree at each node, and let ^f = (A^{^, E^) for /z = 
1, . . . , mi and Q^ = {N2, E2) for u = 1, . . . ,m2 be the strongly connected components of Qi 
and Q2 respectively. Then, there exists a cycle Ci G Qi such that all nodes on this cycle belong 
to [J^li N2 , and a cycle 02 € Q2 such that all nodes on this cycle belong to [J"^li N^ . 

Proof. Pick /xi G {l,...,mi} and consider the digraph ^2[A'^f^] induced by A''^^ Then, 
either this induced digraph has a cycle and the claim is true, or it is acyclic. In the latter 
case, let i G N^^ be a leaf in ^2[-^r^]; i-e. a node with no edges back into N^^ . Let 
M = {j \ {i,j) e E2}. As z is a leaf in G2[N^'], we have M fl N^' = 0. There is a cycle 
c E Qi which goes through i. Select j & M and consider the path co (i, j) (first turn around 
along c in Qi then move i — )■ j in ^2)- As the digraphs commute, there is a path P = {i, k)oP' 
connecting node i with node j such that {i,k) G E2 and the path P' G Qi is of the same 
length as c. Hence, for each node j & M there exists a node k & M such that k has access 
to j in Qi. This implies that some nodes in M lie on a cycle in Qi so that M intersects a 
component Q^^ of Qi. 

Consider the digraph ^2[A'^r^]- If h is not acyclic then the claim is true, otherwise we take 
j G M n Ni'^ and proceed to a leaf k accessed by j in ^2[A'^f^]. We have obtained a path 
from i to A; in ^2) whose nodes lie in [J^li N^. Arguing as above we can continue this path 
until we obtain a cycle C2 in Q2 which has all its nodes in lj™^i N^. The cycle ci in Qi which 
has all its nodes in IJ^^^ A^2 is obtained analogously. The claim is proved. D 

Theorem 15.41 implies notable facts about the critical digraphs of two irreducible commuting 
matrices in max algebra. 

Theorem 5.5. // two irreducible matrices A, B E R"^" commute, then the conclusion of 
Theorem 5.4 holds for the strongly connected components of C{A) and C{B). In particular. 



A and B have a common eigennode. 

Proof, li A,B G M"^" commute, then they have a common eigenvector u by Corollary 13.31 
If these matrices are irreducible, then u is positive and U := diag(M) can be used to make 
a simultaneous diagonal similarity scaling: A := U^^AU and B := U~^BU. Evidently, 
AB = BA. Also, we have C{A) = C{A) and C{B) = C{B). Notice that A^^\ resp. B^^\ is 
the incidence matrix of the saturation digraph of u with respect to A, resp. to B. These 
saturation digraphs will be denoted by Qi and Q2, respectively (with the intention to use 
Theorem 15.40 . By Lemma |5.3[ we have A'^^i?'^] = fi'^^ylt^l. As Qi and Q2 are saturation 
digraphs, each node in these digraphs has a nonzero out-degree. Applying Theorem 15. 4[ we 
obtain that its conclusion holds for the strongly connected components of Qi and ^2- By 
Proposition 15. 11 these components are precisely the strongly connected components oi C{A) 
and C{B). Now the conclusion of Theorem 15.41 also implies that A and B have a common 
eigennode. D 

Let us consider a special case, which usually appears if A and B are chosen at random. 

Corollary 5.6. Let two irreducible matrices A, B e M"^" commute. If C{A) = (N^, E^) 
and C{B) = {N^ ,E^) both consist of just one cycle, then N^ = N^ . 
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6. Examples of commuting matrices in max algebra 



In this section we give several examples in max algebra, which will appear now as the 
semiring (M U {— oo}, max, +), i.e. the set MU {— C)o} equipped with max as "addition" 
and the usual sum as "multiplication". This semiring is isomorphic to (M_|_,max, x) via the 
logarithmic transform. 

Consider the irreducible commuting matrices 



Ai 



2 


1 


— oo 


1 


-1 


-2 


1 


— oo 


-2 



and A2 






-1 


-1 


—00 





-4 


-3 


—00 






Then, it is straightforward to check that X{Ai) = X{A2) = 0, N^^ = {1,2} and N^^ = 
{1,2,3}. Therefore, as claimed in Theorem 15.51 Ai and A2 have a common eigennode. 

In order to compute their common eigenvectors, we apply the method described in Sec- 
tion [331 Since 

' 1 -l\ / -1 -1' 

Q{Ai) = I -1 -2 and Q{A2) = -7 -4 
-10-2/ 1-3 -4 



it follows that 



Q{A,)Q{A2] 



1 


-1 


-1 


-2 


-1 


-2 



Then, by flT^ we have 

V{Ai, 0) n V{A2, 0) = V{Q{Ai)Q{A2), 0) = {A(l, 0, Of | A G M U {-00}} 
The following example of commuting matrices illustrates Lemma 14. 6[ Let 



A 



1 


—00 


—00 


1 





—00 





1 


1 



and B 



'0 0^ 



.0 0, 



Then, A and B commute, B is irreducible and A satisfies the conditions of Lemma 14.61 
As an example of reducible commuting matrices, consider 

/ —00 —00 — oo\ /6 

5 



Ai 



V- 






—00 


—00 


— oo\ 


1 


3 


— 00 


—00 


2 


—00 


-1 


—00 


-00 


— 00 





2 / 



and A-) 



V5 



—00 


—00 


— oo\ 


7 


— 00 


—00 


—00 


5 


—00 


—00 


6 


8 



The classes of these matrices are their diagonal elements. Since the Perron roots of the 
classes (i.e. the diagonal entries in this case) of each of these matrices are distinct, we know 
by Theorem 14.81 that the transitive closure of the reduced digraph associated with these 
matrices are the same, even if these digraphs are different, as can be easily checked. By the 
same theorem, we know that the spectral classes of the associated reduced digraph coincide. 
In this case, for both matrices the spectral classes are 2 and 4. Each of these matrices has 
two different eigenvalues corresponding to their spectral classes. The eigenvalues of Ai are 
3 and 2 and the ones of A2 are 7 and 8. 
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7. Classical nonnegative matrices 

In this section we assume knowledge of some basic results on nonnegative matrices found 
in e.g. [3] or [20]. We state analogs for nonnegative matrices in classical matrix algebra of 
the results for matrices in max algebra proved in Section [3] (except for the last subsection) 
and in Section |H The results and proofs are essentially identical. We first need to redefine 
some symbols and terms. 

Let A G M"^". Following standard terminology, we call an eigenvalue A of A a distinguished 
eigenvalue of A if A > and there is a nonnegative eigenvector corresponding to it. In this 
section, A{A) will be the set of distinguished eigenvalues of A and V{A, A) the convex cone 
of nonnegative eigenvectors (and the vector) associated with a distinguished eigenvalue 
A. By the Perron- Frobenius theorem, A{A) is nonempty and the largest element in A{A) is 
called the Perron root of A. Moreover, any eigencone V{A, A) is finitely generated, and the 
intersection of finitely generated convex cones is again finitely generated. Matrices leaving 
a cone invariant in M" (indeed in M") have been much studied, see e.g. |2Bj. Proposition 13.41 
is well known in this context. 

Lemma 13. ![ Theorem 13. 2[ Theorem 13. 5[ Corollary 13.31 and their proofs go through without 
further change to the classical nonnegative case, except that we need to insert the adjective 
"nonnegative" in Corollary 13.31 

Corollary I3.3I A-. If A,B G M"^" commute, then they have a common nonnegative eigen- 
vector. 

It follows that if A and B are commuting nonnegative matrices and one of them is irre- 
ducible, then they have a common Perron vector. 

Theorem 13.61 and Corollary 13.71 are also valid in the classical nonnegative case under the 
following assumptions: the matrices Ai, . . . ,Ar E M"^" commute in pairs and p{xi, . . . , Xr) is 
a real polynomial such that p{Ai, . . . , Ar) is nonnegative and, in the case of Corollary 13. 7[ all 
the coefficients of p{xi, . . . , Xr) are nonnegative. In the latter, by the analog of Remark 14. 7[ 
we need to assume only one of the A^ is irreducible. 

Turning to Section HJ we again construct the reduced digraph of A G M"^" and we now 
label each class /i with its classical Perron root a^. By a theorem of Frobenius [IH], we 
replace Theorem 14. II by: 

Theorem I4.1I A. Let A G M"^" and A G IR+. Then, a subset U of N is the support of a 
nonnegative eigenvector associated with A if, and only if, 

(i) There is an initial segment I such that U = U^^jN" , 
(a) All final classes u in I are premier spectral and satisfy a^ = \. 

See e.g. [M]. We observe that the supports of nonnegative eigenvectors of A G M"^" 
are completely determined in Theorem 14. IR by (i) the classes (i.e. the strongly connected 
components) of Q, (ii) the Perron roots of these classes and (iii) the access relations of TZ 
(equivalently the edges of TZ*). A similar remark holds for Theorem 14. II and other results in 
Sections S] and [71 

We restate Corollary 14.21 as: 

Corollary IISIA. Le^ AG M+^". Then, 
(i) X is a distinguished eigenvalue if, and only if, there is a premier spectral class v such 
that a^y = X; 
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(a) u is a premier spectral class if, and only if, there exists a nonnegative eigenvector with 

support Intl(z/); 
(Hi) If u is a premier spectral class, then any nonnegative eigenvector associated with a^ 

whose support is contained in \vA\{y) has its support equal to \vA\{y); 
(iv) If the reduced digraph of A has a unique premier spectral class v with Perron root a^, 

then any nonnegative eigenvector associated with a^ has support Intl(i/); 
(v) If the Perron roots of all classes are distinct, then all nonnegative eigenvectors have 
support \ni\{y) for some premier spectral class v. 

The analog of Corollary 14.31 in nonnegative linear algebra is well known, but we need to 
replace ([ii]) of Corollary 14.31 by: "The Perron root of any final class is A (A) and all final 
classes are premier spectral" . Lemma 14.41 goes through without change except that we 
need to replace "eigenvalue" with "distinguished eigenvalue" and Lemma 14.51 also holds in 
nonnegative linear algebra. 

In the classical nonnegative case we obtain the following known stronger form of Lemma l4.6l 
which may be found on [3l p. 53]. We give a short proof along the lines of the proof of 
Lemma 14.61 

Lemma I4.6I A. If A,B G M"^" commute and B is irreducible, then the Perron root of A 
is its unique distinguished eigenvalue. Moreover, if A is reducible, it is completely reducible 
(viz, the direct sum of irreducible matrices after a permutation similarity) . 

Proof. We repeat the proof of ^ of Lemma 14.61 to show that both A and A^ have positive 
eigenvectors. This implies that all initial and final classes in the reduced digraph of A are 
premier spectral with Perron root \{A). But a premier spectral class cannot have access to 
another premier spectral class with the same Perron root. It follows that all initial classes 
are final and vice versa. This means that a class has access only to itself, which proves the 
lemma. D 

Theorem 14.81 also holds in nonnegative algebra, with exception of the last part of fliiT|) 
whose proof is specific to max algebra. Thus we obtain the following main theorem of this 
section. 

Theorem I4.8I A. Suppose that Ai, . . . ,Ar G M"^"" pairwise commute and that all classes of 
Ai, for each i G {1, . . . , r}, have distinct Perron roots. Then, 

(i) All classes of Ai, . . . , A^ and Ai + ■ ■ ■ + A^ coincide; 

(ii) The transitive closures of the reduced digraphs of Ai, . . . ,Ar and Ai + - ■ ■ + Ar coincide; 
(Hi) The reduced digraphs of Ai, . . . ,Ar have the same premier spectral classes, which are 
premier spectral classes of Ai + - ■ ■+Ar. In particular, Ai, . . . ,Ar have the same number 
of distinct distinguished eigenvalues; 
(iv) Let /ii, . . . , fijri be the common premier spectral classes of Ai, . . . ,Ar and denote the 
Perron root of the fij-th class of Ai by a^. Then, for any real polynomial p{xi, . . . , Xr) 
such that p{Ai, . . . , Ar) is nonnegative, the distinguished eigenvalues of p{Ai, . . . , Ar) 
are precisely p{a{, . . . , al) for j = 1, . . . ,m (possibly with repetitions). 

We end this section with an example to illustrate Theorem I4.8I A. 
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Example 7.1. Let 

A= \ 5 1 and 5 



10 








5 








2 


3 


3 




Then, AB = BA. The classes of A and B are their diagonal elements, and the skeleton of 
their reduced digraphs (meaning the diagram of cover relations) is 

1^2<-3. 

The premier spectral classes of both matrices are 1 and 3 and the distinguished eigenvalues 
are the corresponding entries. Their common (nonnegative) eigenvectors are (2, 1, 1)^ and 
(0, 0, 1)"^, respectively. 

Of course, A^ and B^ also commute. Note that the skeleton of their reduced digraphs is 
obtained by reversing the arrows in the diagram above. The only spectral class of A^ or B^ 
is 1 and their common eigenvector is (1, 0, 0)"^. 

We also observe that p{A, B) = A^B — AB > satisfies the conditions of (Irvl) of Theo- 
rem 1121^. 
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